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Past theoretical work has shown that it should be possible to estimate the atmospheric 
refraction of radio waves quite accurately simply from a knowledge of the radio refractive 
index at the surface of the earth. Prediction equations have been developed for use in esti- 
mating both elevation angle errors and radio range errors by means of performing Linear 
regressions of ray-traced refraction variables on the values of surface refractivity, N 8 , for a 
standard sample of radio refractivity profiles. In this paper the accuracy of these prediction 
equations is examined through a comparison with some precise measurements of total abso- 
lute refraction made wit h a radio sextant by the Collins Radio ( Jompany, some absolute eleva- 
tion angle error measurements made at White Sands Missile Range in the Lower atmosphere, 
and measurements of both relative elevation angle error and relative range and range differ- 
ence errors made over various paths in t he lower atmosphere. The validity of the refractive 
index profile sample used is confirmed through a test on some independent data obtained 
from four locations well outside the area of selection of the original sample. All results are 
shown to be consistent with the theoretical prediction model. 



1. Introduction 

The atmospheric radio refraction effects considered 
in this paper are of two genera] types: errors in 
measuring' distance by means of timing the transit of 
radio signals between two points, known as radio 
range errors, and errors in estimating the elevation 
angle of a target by means of measuring the angle of 
arrival of radio signals from the target, known as 
elevation angle errors. Many methods have been 
proposed to take into account these refraction effects 
for the purpose of improving measurements by re- 
moving systematic bias. One of these involves the 
use of the surface value of the radio refractivity, 
N s , a quantity which can be measured directly with 
a microwave refractometer, or calculated from the 
ordinary meteorological variables of temperature, 
pressure, and humidity, to predict values of either 
range error or elevation angle error; this method has 
been shown theoretically to be useful, with the accu- 
racy increasing with increasing initial elevation angle 
[Bean and Cahoon, 1957; Bean, Cahoon, and Thayer, 
1960; Thayer and Bean, in progress]. It is the pur- 
pose of the present note to compare recent experi- 
mental determinations of atmospheric refractive 
effects with values estimated theoretically from sur- 
face meteorological conditions. 



2. Theory 

The operation of a radio tracking system depends 
on the measurement, in some manner, of radio signals 



received from the target. The radio signals are 
transmitted in the form of radio waves which travel 
from the target to the tracking system. The form 
of these radio waves is distorted by the 4 presence of 
the earth's atmosphere. Since solutions of the wave 
equation are extremely difficult to obtain for the case 
of general atmospheric propagation over a spherical 
earth, it is common practice to evaluate refraction 
effects by means of ray tracing, a process which is 
based on the use of Snell's law: 



Mi sin £i=M2 sin £ 2 , 



(1) 



which gives the relationship between the angles of 
incidence &, £ 2 of a plane wave front as it passes 
across a plane boundary between media of refractive 
index /z b /jl 2 . 

It can be shown [Smart, 1931] that if the radio 
refractive index, n, of the atmosphere is a function 
only of height above a smooth spherical earth, then 
the application of Snell's law will result in the follow- 
ing ray-tracing equation, commonly referred to as 
Snell's law for a spherically stratified atmosphere: 



nr cos 6=71q r cos 6 Q . 



(2) 



Here n, and hence 0, the local elevation angle of any 
point on the ray path, are functions of r, which in 
turn is equal to the radius of the earth at the surface, 
usually taken as r , the point of origin of the ray 
path, plus the height, h, above the earth's surface. 
Figure 1 shows some of the geometry involved in ray 
tracing. 
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RADIO RAY - 




Figure 1. Geometry of radio ray refraction. 



Based on the foregoing assumptions, the expression 
yielding the total refraction of the ray between the 
surface and any point, 1, on the ray path can he 
derived as [ibid]: 



-J. 



dn 



o n 



cot 6: 



(3) 



the minus sign merely defines downward bending as 
positive. 

One of the two types of refraction errors considered 
in this paper is the elevation angle error, e, which is 
the difference between the apparent direction to a 
target, as indicated by the angle of arrival of the 
radio wave front, and the true direction. This error 
is primarily a function of the refraction, or bending, 
of the radio ray, given by (3); for targets beyond the 
atmosphere the two quantities are asymptotically 
equal (with increasing range) . The values of e and r 
at any point on the ray path obey the following 
inequality: 

Equation (3) can be integrated by parts, without 
knowledge of the refractive index profile, yielding 



T=(n —n 1 ) cot ( 



•-/> 



n—l) esc 2 Odd 



r = (N s -N 1 )X10-«eot o -lCr 6 I N esc 2 Odd (4) 

where iV=(n-l)X10 6 , the excess of the refractive 
index over unity in parts per million, and N s is the 
surface value of N. The subscripts and 1 refer to 
values at the lower and upper parts on the ray path 



over which the integration is taken. It has been 
shown [Schulkin, 1952] that the integral part of (4) 
contributes less than 3.5 percent to the value of r for 
O larger than about 10°. 

Thus the bending of a radio ray may be expressed 
by an equation of the form 



T=a+bN s 



(5) 



where a and b would be functions of the initial 
elevation angle of the ray, O , and the height (or 
range) along the ray path at which the bending is to 
be calculated. Such an assumption can be checked 
by examining the behavior of values of r, ray traced 
for a number of observed height-profiles of radio 
refractive index, plotted against the corresponding 
values of N s . Such a plot is shown in figure 2, for a 
small initial elevation angle, 50 mr (milliradians) 
(about 3°), and a "target" height beyond the atmos- 
phere, 70 km. The family of iV-profiles used in ray 
tracing this sample of bending values is referred to as 
the CRPL Standard Sample. 1 It can be seen from 
inspection of figure 2 that the assumption of linearity 
expressed in (5) is justified for this case. A similar 
conclusion can be reached from examination of data 
for other cases, including low target heights and 
elevation angles down to zero degrees, although for 
these extremes the degree of correlation between 
e and N s is not as marked as that shown in figure 2. 

The other refraction variable treated in this paper 
is the radio range error, Ali e , which is here defined as 
being that error incurred in measuring the distance 
between two points by means of timing the transit of 
radio signals between the points, and assuming that 
the velocity of propagation is equal to that of free 
space. For the case of a radio ray, this error is com- 
posed of two parts: the difference between the curved 
length of the ray path, called the geometric range, 

1 Meaning explained in section 3. 




Figure 2. Total refraction at d = 50 mr, h=70 km, for the 
CRPL Standard Sample. 

Line indicates least squares linear regression of r on N s . 
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R g , and the true slant range, //,,; and the discrepancy 
caused by the lowered velocity of propagation in a 
refractive medium. The geometric range is given by 

r h t 
R g = esc edit , 

Jo 

and the apparent, or radio, range by 

r h t 

R e = I n esc 6:1 h. 

Jo 

Thus the total radio range error, AR e =R e —R , is 
given by 

C h t 
AR e = n esc ddh—Ro, 

Jo 

or 

AR e = 1 0" 6 f ' A r esc Odh+ f ' esc ddh - R Q . (6) 
Jo Jo 

The first term on the right-hand side of (6) is the 
"velocity" or "refractivity" error, AR N ] the last 
two terms represent the geometric range error, 
AA%, which is the difference in length between the 
straight path, R , and the curved ray path, R g . 
Table 1 gives some typical and extreme values of 
range errors ray traced for observed 2V-profiles. 



Table 1. Typical and extreme values of range errors for 
targets beyond the atmosphere 



00 


Typical iV s ^;320 


Extreme: .V,^400 


Maxi- 
mum 




AR g 


AR.v 


AR e 


AR g 


ARn 


AR e 


ARg/ARe 


Milliradians 



Meters 

10 
2.5 
. 7 
.14 
.02 
. 001 


100 
62. r> 
38. 1 
22. 26 

11.0 
5.01 


110 
65 

38.8 
22.4 
11.0 
5.01 


60 

4.5 

1.0 
.2 
.03 
. 002 
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73 
43 
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13.0 
5.50 
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44 
25 
13.0 
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% 
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.23 
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o- f" 

Jo 



From table 1 it can be seen that the geometric 
range error, AR (h does not represent a significant 
proportion of the total range error except at very 
small initial elevation angles, between zero and 
about 8°. This being so, the behavior of the total 
range error will be primarily a function of the first 
integral in (6) for elevation angles greater than about 
3°. The integral expression 

AR e ^10~ 6 ( ' .V esc edit, 
Jo 

may be rewritten as 
Ndh 



or 



1-2 sin 2 (L^9\ + voi e Q sin (0-0 o ) 
AA\~cse e P ' Ndh+Jt (-1)' +1 f ' .V ["cot 6 sin (d-d )-2 sin 2 (^)l' dh, (7) 



fove<2e 0) eo>o. 



This expression is analogous to that derived for the 
case of ray bending, (4), and similarly the integral 
series on the right hand side of (7) contributes only 
3 percent or less to the value of AR e for 6 larger than 
about 10°. From (7) one would thus suspect that 
the radio range error might be well estimated as a 
linear function of the integral of N with respect to 
height. In treating this integral, it is informative 
to note that any given N(h) profile may be "broken 
up" into three primary components: 

N(h)=N'(N„ h)+N"(h+h s ) + 8N(h) 

where N' is that part of the profile which can best 
be expressed as a function of N s and height, N" is 
a standard distribution of refractivity with respect 
to altitude above mean sea level (h-\-h s ) which is 
independent of N s , especially above the tropopause, 
and 5A r represents a random component of the 
profile which cannot in general be accounted for 
a priori. The A^ component is generally effective 



over the first few kilometers, while above 6 or 7 km 
altitude the N" component forms the bulk of the 
profile [Bean and Thayer, 1959a]. Thus the integral 
of the N profile with respect to height may be 
written as: 

Ndh=\ N'{N Si h)dh 

Jo Jo 

N"(h+h s )dh+ 8N(h)dh, 



+ 



or, 



f 



Ndh=F l (N s , h,)+F 2 (h s , h,)+SF(h t ) 



where 8F is the random contribution to the integral. 
For any particular h t then 



f 



Ndh=F l (N s )+F 2 (h s )+8F 
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or 



f 



Ndh=F 2 (h s =0)+F 1 (N s )-F z (h s )+8F (8) 



N"(h 

Jo 



+ h 8 )dh, and F 2 (h s = 0) is a 



where F^ 
constant. 

It was found empirically, from integrated N(h) 
profiles, that 



f 



Ndh^a+biNs-b-AiS.E.; 



(9) 



the analogy between (8) and (9) is plain, where the 
standard error of estimate of (9), "S.E.," represents 
the standard deviation of 8F of (8). The results of 
such an empirical study are shown in figure 3, for 
the CRPL Standard TV-profile Sample, for h t beyond 
the atmosphere. 

For any particular application of (9) at a single 
location the term b 2 h s will be absorbed into the 
constant a, since h s does not vary. However the 
introduction of this term is necessary to explain 
the station elevation dependence of integrated N(h) 
profiles when taken from a sample containing 
stations at widely differing elevations, such as the 
Standard Sample. 

It is thus apparent that radio range errors, at 
least at the higher elevation angles, are primarily 
a linear function of N s . That this is also true at 
comparatively low angles is shown in figure 4, for 
O =5O mr (about 3°) for the same profile sample. 
The reader should especially note the similarity of 
the distributions of the points about the regression 
lines between figure 3 and 4, showing that the range 
errors at about 3° are still primarily a function of 
the integral of N with respect to height, or the 
range error at 90°. 

It has thus been demonstrated that, theoretically, 
it should be possible to estimate both the angle of 
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Figure 3. Integrated refractive index profiles for the CRPL 
Standard Sample. 

The integral of N(h) with respect to height is taken from the surface to 70 km, 
above which point N(h)=Q. The line represents the least squares regression 
of /'(») on N 8 , where /'(«>) is the value of the integral as adjusted for the de- 
pendence on station (surface) elevation above mean sea level. 




POINTS FOR DENVER, COLO. , AND 
ELY, NEV. ; SHOWN ALSO AS : 

ADJUSTED FOR ELEVATION 
DEPENDENCE (AR' e ) 



Figure 4. Total range error at d () = 50 mr, h=70 km, for the 
CRPL Standard Sample. 

The hue indicates the least squares regression of A/?/ on N„, where A/?/ is the 
total range error as adjusted for the dependence on station elevation. 



refraction of radio rays and errors in radio range 
measurements from measurement of the refractive 
index at the surface of the earth. This should be 
true for targets in or beyond the atmosphere, at 
elevation angles down to, and possibly lower than, 
3°. In addition, if the behavior of refractive index 
profiles is similar in different parts of the world, it 
should be possible to specify "universal" values 
of the coefficients in (5) and (9), and to pre- 
dict these values in advance by analysis of a 
large heterogeneous sample of refractive index 
profiles. In the succeeding sections of this paper 
it will be shown how this has been done, and a 
comparison will be made between the results so 
derived and the results of some measurements over 
actual radio paths. 

3. CRPL Standard Atmospheric Radio 
Refractive Index Profile Sample 

In the preceding section it was shown that, 
theoretically, it should be possible to estimate either 
radar elevation angle errors or radio range errors at 
any particular location by means of a system of 
linear equations in N s , where the coefficients are 
functions of the target position. The target position 
can be specified by either the apparent elevation 
angle and target height, or the apparent range and 
target height (or as a third possibility, the apparent 
range and elevation angle), each having advantages 
in different situations [Thayer and Bean, in progress]. 
The equations recommended are: 



and 



e=a 1 (d (h h t ) + b l (d ,h ( )N s ±S.-E. 1 (d, h h ( ) (10) 



AR e =a 2 (K e ,h t ) + b 2 (R e ,h t )N s ±S.-E, 2 (R e ,h ( ) (11) 
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where e is the elevation angle error (see fig. 1), 
A/»\ is the radio range error, () is the apparent ele- 
vation angle, h t is the target height, R e is the ap- 
parent radio range, and S.E. is the standard error 
of estimate about the regression line of e or AR e 
on N s . Values of the coefficients may be obtained 
by performing linear regressions of e or AR e , as ray 
traced for an appropriate sample of radio refractive 
index profiles, upon N s for a large matrix of target 
positions. As a by-product of these calculations 
one also obtains, for each target position, a value 
of the residual error (the standard error of estimate) 2 
to be expected for the particular type of profile 
sample used. 

In order to obtain a general set of equations to be 
useful under arbitrary conditions of location, climate, 
and weather, a large sample of iV-profiles has been 
assembled which is believed to be representative of 
both mean climatic and geographic trends and the 
larger synoptic variations which may be encountered. 
This was done by choosing 13 radiosonde stations 
representative of the major geographic and climatic 
types of the world, and then choosing from each sta- 
tion 6 iV-profiles of particular types, two of which are 
typical of the extremes of monthly mean conditions 
for that location, and the other four of which are 
typical of some of the variations which are found at 
that location [Bean, Cahoon, and Thayer, I960]. 
The result is a sample of 77 3 TV-profiles which has 
been found over a period of years to be a sound cross 
section of general refractive conditions and has thus 
been named the CRPL Standard Atmospheric Radio 
Refractive Index Profile Sample, hereafter referred 
to as the CRPL Standard Sample. Although the 
locations chosen for this sample are heavily weighted 
towards the United States, it has been found that the 
general behavior of the refractive index structure as 
inferred from the standard sample is typical of con- 
ditions experienced in most parts of the world 
[Misme, I960]. 

The remainder of this paper will be devoted to 
some comparisons of observed radio refraction data 
with the predictions supplied by the CRPL Standard 
Sample, as derived from the linear regressions men- 
tioned above. 

Since the refraction measurements reported here 
consist of samples taken at particular locations over 
comparatively short periods of time, the} r should 
provide a test for the general set of coefficients 
derived from the Standard Sample; not only is the 
general theoretical approach tested against measured 
values, but the measurements coming from places of 
more or less homogeneous nature, they provide a 
check as to whether or not coefficients derived for a 
large heterogeneous sample of data are applicable 
also to individual places and times; i.e., they should 
reveal how much of the observed correlation of the 
heterogenous sample is derived from correlation 
between "classes" of data (in the statistical sense). 



3 For the Standard Sample the standard error of estimate is equal to the standard 
prediction error within ±1 percent over the range of N s from 200 to 470, and will 
be used interchangeably with the latter. 

3 One of the types could not be found for one of the stations used. 



For a more thorough treatment of the CRPL Standard 
Sample and the associated regression coefficients for 
range error and elevation angle error, the reader is 
referred to a forthcoming publication [Bean, Thayer, 
et ah, in progress]. 

4. Comparison With Independent Data 

Before turning to an examination of the experi- 
mental refraction data and the degree of success 
realized in applying the theoretical prediction model 
to those data, it seems appropriate to examine the 
accuracy of the prediction model when applied to 
some independent theoretical (i.e., ray-traced) data. 
For this purpose four cheek stations were selected 
which were not only independent in the sense of not 
having been included in the original 13 station 
Standard Sample, but were from locations widely 
differing from the region of selection of the original 
sample. It was decided to select one station repre- 
sent at ive of an arctic type climate, one temperate, 
one tropical, and one 4 from a "problem" climate area. 

Amundsen-Scott station at the South Pole (lat. 
9()°S) was chosen as the arctic type; this station was 
expected to present the most rigorous test of the 
prediction model (as based on the Standard Sample) 
that could be obtained anywhere in the 4 world. In 
the first place the extreme arctic-continental climate, 
with almost no water-vapor contribution to the 
refractive index and the nearly incessant tempera- 
ture inversion, is more alien to the Standard Sample 
than any other type; in the second place the station 
elevation is 2,800 m, which is 900 in in excess of the 
highest station (Ely, Nevada, 1,908 in) included in 
the Standard Sample. These two effects were 
expected to augment each other as regards refraction. 

Dakar, Senegal, on the western coast of Africa, 
was selected as a "problem" climate station; an 
inverse relationship exists there between N s and 
A/V (the iV-gradient over the first kilometer 
above the surface). A Congo basin station, Bangui, 
in what was French Equatorial Africa, was selected 
as the tropical location, and Moscow, U.S.S.R., was 
selected as the temperate location. 

In order to combine brevity with comprehensive- 
ness, ray tracings were done of the total refraction 
(bending at 70 km target height) at two elevation 
angles, 20 mr and 100 mr, for six profiles from each 
location. The six profiles were selected as repre- 
senting roughly the range of N s in winter (February), 
summer (August), and spring-fall (May and Novem- 
ber), two profiles being selected from February, two 
from August, and one from each of May and Novem- 
ber. The 20 mr elevation angle was selected as 
representing roughly the lower limit of elevation 
angles for which the bending is expected to be 
strongly correlated with N s (say r>0.9), while at 
100 mr (about 6°) the correlation is expected to be 
extremely high (say r>0.99) and the refraction 
should be reasonably free of random profile effects. 

The results of the ray tracings and the comparisons 
with predicted values are shown in figure 5. As 
expected, the results from the South Pole seem to 
depart significantly from the predicted values at 
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Figure 5. Comparison of predicted refraction at h= 70 km for 6 Q =20 mr and 100 mr from regressions 
of the CPRL Standard Sample and ray-traced values from four independent locations. 

Solid lines indicate observed regressions of r on JSF S , dashed lines indicate regression lines from the CRPL Standard Sample and 
their standard prediction errors (67% confidence limits). Prediction error limits not shown for 00=100 mr because of the 
very small difference from the regression lines. 
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least for the 20 mr elevation angle. At the 100 mr 
elevation angle some of the calculated points lie 
more than one standard deviation from the pre- 
dicted line (the theoretical prediction error is too 
small to show on the graph clearly), however, in all 
four cases the differences are less than 50 micro- 
radians, a figure which as shall be seen may represent 
the limit of accuracy obtainable from the atmosphere 
in actual practice. At angles over 100 mr the errors 
would be smaller; in fact they should tend to decrease 
in inverse proportion to the square of the initial 
elevation angle, as indeed they do between 20 and 
100 mr. 

A conclusion which may be drawn from the above 
results is that any regions where the prediction 
model based on the Standard Sample would not be 
expected to provide the theoretical accuracy are 
probably regions of climatic extremes, and at least 
for the case of angular errors the effects will be neg- 
ligible for elevation angles of a few degrees or more. 
As an interesting aside it can be noted that appar- 
ently the Antarctic may be a desirable area, for 
tracking systems location, at least with respect to 
atmospheric refraction effects, since (most likely be- 
cause of the lack of substantial water vapor and 
the relatively homogeneous conditions) the predic- 
tion error for 9 o =20 mr in figure 5a is only about 
one-fifth as large as for temperate climates, indicat- 
ing a possibly more stable atmosphere (even 90% 
confidence limits for the S.E. in figure 5a yields a 
value less than half of the theoretical temperate 
value of ±0.286 mr). 

5. Comparison With Experimental Results 

Before comparing the theoretical and experimen- 
tal results it is appropriate at this point to examine 
what one would expect to observe on the basis of 
propagation theory. In the case of angular errors 
it is expected that propagation through the real, 
turbulent atmosphere will produce random varia- 
tions in the shape of the incoming wavefront, so 
that measurements made with systems in which the 
receiving antenna is alined with the incoming signal 
will have random variations introduced in addition 
to the ordinary refraction effects. Since these vari- 
ations will probably not be a function of elevation 
angle to any great extent, this implies that the resid- 
ual variance in predicting the elevation angle errors 
will probably always be greater than predicted from 
theoretical (static) considerations, and that there 
will probably be some minimum value of this vari- 
ance for very large elevation angles. Thus in some 
cases the residual errors will probably not decrease 
steadily with increasing elevation angle, but will 
tend to flatten out at some point and assume a 
more or less constant value above that point. These 
effects will be complicated in comparing one set of 
djita with another by such things as differences in 
the location or time of day or season in which data 
is taken, and instrumental effects such as aperture 
averaging. 

The case of range errors is more straightforward. 
The effects of turbulent atmospheric inhomogeneities 



are expected to average out over regions of ab- 
normally high or low density, or water vapor con- 
centration, when considering the transit time of 
particular points on the wave front. Hence the 
effect on the residual range errors is expected to be 
small, and the observed values are expected to com- 
pare rather well with the predicted (theoretical) 
values. 

Turning first to the comparison of observed and 
predicted elevation angle errors, figure 6 shows 
some data on the mean refraction of 1.85 cm radio 
waves received from the sun, a target at essentially 
infinite range so that the elevation angle error is 
identical with the total angular bending of the radio 
ray, r. The data shown in figure 6 were obtained 
by tracking the sun with a precise radio sextant 
developed by the Collins Radio Company, and were 
collected in August through December of 1959 at 
Cedar Rapids, Iowa [Anway, 1901 1. These data 
represent essentially instantaneous measurements. 
The mean of all observations at each elevation angle 
is plotted for elevation angles ranging from 2° to 
65°, and the mean value of N s associated with each 
point is about 332; the curve for the mean bending 
of the CRP.L Standard Sample corresponds to the 
mean value of N s of 334.6 for that sample and hence 
the data should be comparable. The standard 
deviation "wings" refer to the standard deviation 
of the individual "instantaneous" data, not to the 
standard error of estimate of the mean value. The 
close agreement observed for elevation angles be- 
tween 2° and 35° constitutes not only a confirmation 
of the usefulness of the Standard Sample, but also 
a verification of the accuracy of ray-tracing theory 
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Figure 6. Comparison of measured total atmospheric refrac- 
tion of 1.85 cm radio waves at Cedar Rapids, Iowa, with 
values predicted from N s . 

Upper curve and data points: mean value of refraction; lower curve and data 
points: the standard deviation of the refraction values about the mean. The 
wins;s on the mean refraction data points indicate the limits of the standard 
deviation of the observed data. 
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in estimating radio wave refraction in the actual, 
and thus heterogeneous, atmosphere. The standard 
deviation of the Collins data (shown on the lower part 
of fig. 6) is generally lower than for the standard 
sample, but this is to be expected in view of the 
larger range of climatic variation contained in the 
CRPL standard profile sample. The apparent 
discrepancies in the measurements made at elevation 
angles over 40° are apparently due to some slight 
inaccuracies in the calibration procedure used on the 
radio sextant during the period of data acquisition 
[Marner, private communication]. 4 In fact, the 
data shown in figure 6 are almost precisely what one 
would expect to observe if all of the measured 
values of refraction were increased by a systematic 
calibration error of about 50 microradians over their 
correct values. The standard deviations in figure 6 
tend to flatten out at high elevation angles, an effect 
which is to be expected theoretically as pointed out 
previously. At any rate, the largest difference 
between the observed data and the predicted curve 
in figure 6, at elevation angles over 30°, is only 
about 50 microradians or 10 sec of arc (the angular 
diameter of the planet Mars at its average distance 
from the earth is 10", an angle not discernible to 
the naked eye). Although this discrepancy might 
be significant militarily, it is only about }{ percent 
of the diameter of the target sun and is probably 
near the limit of accuracy of the equipment used. 

Figure 7 shows the results of the specific measure- 
ments reported by An way for the radio sextant for 
all cases at an elevation angle of 8 ± 0.09° ; each point 
represents an "instantaneous" reading. The solid 
line represents the linear regression of the measured 
refraction data on the values of N s ; the dashed line 
shows the predicted linear relationship derived from 
least squares fits to the CRPL standard sample ray- 
traced refraction data. The mean bias between the 

4 The data for the highest elevation angles in figure 6 were necessarily collected 
during the early part of the period when the sun was higher in the sky. In a 
private communication, An way states that the mean N* applicable to the data 
at 60° to 65° was 358 rather than 332; this difference would account for about 
one-third of the discrepancies noted, reducing the residual bias to a maximum 
of about 40 microradians. 
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Figure 7. 1.85 cm radio refraction at an elevation angle of 
8 deg, Anway, 1961, Cedar Rapids, Iowa. 



two lines is about 40 microradians, interestingly 
close to, and in the same direction as, the apparent 
calibration error noted in the mean refraction data 
at high elevation angles. The standard error of 
estimate is considerably higher than predicted; 
however, the rms uncertainty of ±0.052°, or ±0.91 
mr, in the apparent elevation angle would be suffi- 
cient by itself to increase the standard error of esti- 
mate to about ±0.017 mr, which is four times larger 
than the predicted value. It is not known how much 
of the total standard error of ±0.12 mr is due to 
measurement errors as opposed to unforeseen 
fluctuations in actual atmospheric refraction. 

Figure 8 shows some results of measurements taken 
at Cape Canaveral, Fla., on November 1-3, 1959 
[Janes and Thompson, to be published] at a very 
low elevation angle, about 0.7 mr or 0.04°. These 
are " instantaneous" measurements, taken at half- 
hourly intervals, of the phase difference fluctuations 
between the signals from a beacon as they arrived 
at the upper and lower terminals of a vertical 24-ft 
baseline, thus being very closely equivalent to a 
measurement of the fluctuations in the angle of 
arrival of the wave front at the centerpoint of the 
baseline (the altitude difference between this point 
and the target beacon is referred to as the "mean" 
target height). Since only the fluctuations and not 
the total phase differences were measured, only the 
slope and scatter of the elevation angle errors as a 
function of the observed N s data can be compared 
with the predicted values from the CRPL standard 
sample. The zero point on the graph is set by the 
predicted mean value for the sample. The correla- 
tion coefficient is, as expected, only 0.57. In this 
case the scatter of the observed data is well inside 
the limits of the standard error of estimate of the 
regression for the standard sample, even at this very 
small elevation angle where horizontal changes in 
the N profile can exert a large effect on elevation 
angle errors. 

Figure 9 shows the results of a comparison between 
predictions of elevation angle errors estimated from 
the CRPL standard sample and some measurements 
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Figure 8. Elevation angle fluctuations from phase differences 
taken across a 24-ft vertical baseline, at Cape Canaveral, Fla. 
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made with a 6 cm radar at Tularosa Basin, N. Mex., 
[Anderson, Brers, and Rainey, I960]. Each point 
represents the mean of five "instantaneous" readings 
made at 1-min intervals over ;i period of 4 min. 
The standard deviation of each five-reading group 
averaged 0.16 mr, and the maximum range in any 
one group was 0.58 mr. The radio energy was 
propagated over a 45-mile path at a mean apparent 
elevation angle of 18 mr; the target was a beacon 
located on a mountain peak 5610.5 feet higher than 
the desert floor where the radar was located. The 
data in figure 4 show that even for this rather 
extreme case, where the degree of correlation 
between N s and e is expected to be only 0.4, agree- 
ment is obtained between: 

(1) The predicted and observed mean refraction, 

(2) the observed and predicted slopes of the e 
versus N s relation, 

(3) the observed and predicted residual errors of 
predicting e from A T S alone. 

The small discrepancy between the intercepts (i.e., 
between the mean refraction) of the observed and 
predicted e versus A r . s . lines may be perhaps attributed 
to, for example, antenna lobe pattern distortion 
caused by differential refraction, or defocusing 
[Wilkerson, 1962]. 

The remaining data which arc 4 examined were of 
necessity taken in such a manner as to have a rather 
high degree of autocorrelation (trends). Such data 
are not as suitable for confirming the accuracy of a 
regression prediction process as are independent dat a . 
A discussion of this is included at the end of the paper. 

Turning to examination of radio range errors, 
figure 10 shows the results of some measurements of 
apparent radio range fluctuations over a 25-km path 
on the island of Maui, Hawaii, on November 9-11, 
1956 [Norton et al., 1961]. These measurements 
were made at 1-hr intervals, and are essentially 
"instantaneous" values. The target beacon was 
situated on the summit of Mount Haleakala at an 
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Figure 9. Measured refraction of C-band radar at Tularosa 
Basin, New Mexico. 



elevation of 10,025 ft, while the "ground" station 
was near Puunene Airport at an elevation of 104 ft, 
thus yielding a target height of 3.046 km, in a region 
of critical target heights for prediction of radio 
range errors in tropical climates [Thayer and Bean, 
in progress]. The measured range fluctuations (ab- 
solute errors not measured) are plotted against 
values of N s taken at about the same time (mostly 
15 to 20 min later) by U.S. Weather Bureau personnel 
at the Puunene Airport weather station. The 
agreement between observation and prediction is 
fairly good, especially when one considers that only 
32 of the 86 points lie outside of the predicted 
standard error of estimate limits, while chance would 
indicate that 29 points would exceed these limits. 
Also, it should be kept in mind that in this case, as 
for all except the Collins data, the target beacon is 
located on the surface of the earth, whereas the 
predictions from the CKPL standard profile sample 
are derived for targets in the free atmosphere; there 
is undoubtedly some bias introduced in this way. 

As a part of a continuing investigation into the 
atmospheric limitations imposed on electronic dis- 
tance measuring equipment, some measurements 
have been made recently by the Lower Atmosphere 
Physics Section, NBS, of both, range errors and 
range difference errors (across a phase-differencing 
baseline) over a propagation path near Boulder, 
Colo. Figures 11 and 12 are based on some of the 
preliminary results of these measurements [Thomp- 
son, 1962]. Figure 11 shows the results of measure- 
ments of the fluctuations in apparent range, made 
at half-hour intervals on May 9-11, 1961, over a 
15.5 km path between a transmitting beacon on 
Green Mountain at an elevation of 2242 in and a 
receiving antenna located near Boulder ( 'reek at an 
elevation of 1554 m, the true target height thus 
being 688 m. The apparent range fluctuations, 
expressed in parts-per-million of the 15.5 km path 
length (with an arbitrary zero since the total range 
was not measured), are plotted as a function of the 
surface value of the refractive index taken at a 
point quite close to the lower terminal. Quite good 
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Figure 11. Range error fluctuations observed over the Boulder Creek, Green Mountain path, Colo. 
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Figure 12. Range difference fluctuations observed over a 4.60-m in-line baseline, Boulder Creek, Green 

Mountain path, Colo. 
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agreement is seen between the simple linear regres- 
sion of the observed AR e values on N s and the pre- 
dicted linear relationship obtained from the CRPL 
standard sample. Note that both lines have statis- 
tically equal standard errors of estimate with respect 
to the observed data. 

Figure 12 shows the results of the range difference 
measurements made over a 460-m baseline essentially 
in line with the transmission path, where the second 
antenna was farther from the target beacon than the 
primary antenna. Here the range difference fluctua- 
tions (again with an arbitrary zero) have been plotted 
as a function of the mean value of N s measured at 
each end of the baseline. The zero point on the 
graph is set by the predicted mean of the sample. 
In this case there seems to be some discrepancy 
between the regression of the data and the predicted 
slope, however, note that the standard errors of 
estimate for the two lines are, to two significant 
figures, equal, indicating that the difference in the 
slopes is probably statistically insignificant. 

There are some data points in figure L2 having a 
rather large deviation from the regression lines. 
Statistical theory (using the "Student" ^-distribution 
for 84 degrees of freedom) shows that, if the da I a 
points are drawn from a normally distributed popula- 
tion, there should be only one point having a devia- 
tion of more than ±9iiii)i from the observed regression 
line. There are in fact five such points in figure 12, 
four above and one below the line. I f t hese five points 
are "thrown out," on the grounds that they weight 
too heavily the extremes of the distribution of 
data points (this is especially true when using least 
squares regression), and the regression is then redone 
using the remaining 81 data points, the resulting 
value of the slope is — 0.385mm /AT-unit, with r=0.77, 
compared to the predicted slope of — 0.381mm/iV- 
unit, a rather close agreement. 

6. Discussion of Results 

As a summary of the results of the experimental 
versus theoretical comparisons given in the preced- 
ing section, a statistical analysis has been run on 
the significance of the differences between the slopes 
of the observed and predicted regression lines. In 
order to make the tests more stringent, it was as- 
sumed that the slopes derived from the Standard 
Sample should be taken to be the slopes of the 
population regression lines (/?) , thus yielding an esti- 
mate of the significance of the departure of the 
observed slope from the assumed population value. 

A value of t was first calculated for each case 
using the relation [Bennett and Franklin, 1954] 



tj-2 



S.E. 



(12) 



where b is the observed slope, /3 the assumed pop- 
ulation, or theoretical, slope, x refers to the inde- 
pendent variable in each regression, N s , S.E. is the 
standard error of estimate, and (y_ 2 is the value of t for 
j-i degrees of freedom. From f,_ 2 confidence limits 



for fi at the 100(l-a) percent level can be calculated 
from [ibid] 
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(13) 



The probability that the observed value b would 
have fallen outside of these limits by chance is a. 
Many statisticians consider a value of ^_ 2 falling 
below the 100a: = 5 percent level to be not significant, 
between the 5 percent and 1 percent levels to be of 
questionable significance, and over the 1 percent 
level to be significant [ibid J. An observed slope b 
falling 



l*-fc 



Vsfe-S) 2 



w T ould thus be taken to represent a significant depar- 
ture from the value ft,, and would thus imply the 
possibilities 

(a) ft) does not represent (3 or 

(b) b represents the regression of data from a pop- 
ulation different than that used in determining 
ft), or 

(c) both. 

Before making the significance tests, however, the 
value of j, the number of independent observations 
going into the determination of b, must be known. 
In general, data of the type presented here are more 
or less highly autocorrelated, and hence not all inde- 
pendent. The data presented here, with the pos- 
sible exception of the Collins data and the Tularosa 
Basin data for which the calculations could not be 
performed, have autocorrelation coefficients r k} for lag 
k (k=l, 2, 3 units of time between successive meas- 
urements) that can be approximately described by 



n 



i(r') k 



and for this type of data the effective number of 
pieces of independent data, j, is given by [Brooks 
and Carruthers, 1953] 



j=n [h£} 



(14) 



For the data treated here weighted mean values of 
r' were calculated from 



ri+4^ /2 +9>' 1/3 



+ . . . k 2 r]! 



Ilk 



1+4+9+ 



(15) 



where k was the largest lag for which the autocorre- 
lation coefficient was calculated, usually 4 or 5. 
No special justification is offered for the use of (15), 
other than the obvious fact that r k is to be approx- 
imated by the kih power of r', and hence a func- 
tion of k would seem to be the most logical weighting 
function to use ; the use of k 2 as a weighting function 
seemed to give the best overall fit to the series of 
r k encountered from these data. 
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Table 2. Expe 


rimental 


versus theoretical slopes 
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Is |6-0| 

significant 
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level? 


e vs Ns 

Collins Data, 8° 


48 
161 

86 

86 
155 

86 


0. 00754 
.0103 
. 01356 

. 02833 
.865 

-.344 


0. 00698 
.0102 
. 00648 

.01610 

.879 

-.381 






(48) 
(161) 
6.5 

2.2 
4.0 

2.4 


1.01 
.031 

.708 

3.56 
.32 

.60 


0.68 
.676 
.73 

7.6 
.82 

2.0 


Yes 


Tularosa Basin . 






No. 


Cape Canaveral _._ 


0.870 

.974 
.944 

.957 
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.950 
.950 

.946 


No. 


AR e vs N 

Maui Data 

Boulder Creek Green Mountain... 

A(Aff) vs N., 

Boulder Creek Green Mountain. _. 


No. 

No. 

No 



Table 2 above shows the results of the significance 
tests on the slopes of the various experimental and 
theoretical (predicted) regression lines. The number 
of pieces of data is shown in the first column, the 
observed slope b and theoretical slope ft in the second 
and third columns, the autocorrelation coefficient 
for lag of one time unit in the fourth column, and the 
weighted mean r' as defined in (15) in the fifth 
column. In column 6 the effective number of inde- 
pendent pieces of data, j, is shown, while in column 
7 the value of tj- 2 is shown for the difference between 
b and ft. The next column shows the value of ^_ 2> . 5, 
the value for the 50 percent significance level for 
j — 2 deg of freedom. 

Only one of the t values turns out to be significant 
at the 50 percent level, which means that there was 
a better-than-even chance that such differences 
would have occurred by chance in the other cases. 
In the case of the Collins data at O ~8°, the value 
of J = 1.01 would not be significant at the 25 percent 
level; the value £ 46 =1.01 corresponds to a=0.34, or 
a 34 percent chance that the observed deviation 
\b—ft\ is of a random nature, and thus not significant. 

From the point of view of a statistician, the results 
of these tests are such that no significance can be 
attached to any of the apparent discrepancies be- 
tween theory and observation, and given reason to 
believe that the values of ft are theoretically sound, 
one could say that the results are significantly posi- 
tive in nature. 

The significance of the differences between the 
predicted and observed slopes of the regression lines 
for 0o=2O mr for the independent data check of 
part 4 of this paper were tested using the same 
method as the preceding tests, except that the 6 
observations in each case were assumed to be inde- 
pendent. The results are summarized in table 3 
and confirm the general use of the standard sample 
for O >2O mr. 

From the experimental data which are available 
at the present time it may be concluded that: 

(1) Radio range and elevation angle errors can 
be predicted from the surface value of the radio 
refractive index, and the accuracy obtained will be 
generally commensurate with the estimates of 
residual errors made from theoretical ray-tracing 
considerations. 



(2) The functional dependence of either angular 
refraction or range errors on the surface value of the 
refractive index as derived from the CRPL Standard 
iV-profile Sample may be applied to arbitrary loca- 
tions or climates without a noticeable decrease in 
accuracy over that obtained with a sample from the 
location under consideration. 

(3) The effects of horizontal inborn ogeneities of 
the refractive index, which certainly must have been 
prevalent over the transmission paths for which 
experimental data has been presented, do not appear 
to introduce any bias or additional residual variance 
into the values of observed refraction variables over 
those predicted from surface observations. 

Table 3. — Comparison of slopes for independent check- Pre- 
dicted slope ate o = 20mr: 0.0358 mr/'N a 
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